Building a Computer Poker Agent with Emphasis on Opponent Modeling
نویسندگان
چکیده
In this thesis, we present a computer agent for the game of no-limit Texas Hold'em Poker for two players. Poker is a partially observable, stochastic, multi-agent, sequential game. This combination of characteristics makes it a very challenging game to master for both human and computer players. We explore this problem from an opponent modeling perspective, using data mining to build a database of player styles that allows our agent to quickly model the strategy of any new opponent. The opponent model is then used to develop a robust counter strategy. A simpler version of this agent modified for a three player game was able to win the 2011 MIT Poker Bot Competition. Thesis Supervisor: Leslie P. Kaelbling Title: Professor of Computer Science and Engineering
منابع مشابه
Using Kullback-Leibler Divergence to Model Opponents in Poker
Opponent modeling is an essential approach for building competitive computer agents in imperfect information games. This paper presents a novel approach to develop opponent modeling techniques. The approach applies neural networks which are separately trained on different dataset to build Kmodel clustering opponent models. KullbackLeibler (KL) divergence is used to exploit a safety mode on oppo...
متن کاملPoker Opponent Modeling ∗ Michel Salim and Paul Rohwer
Utilizing resources and research from the University of Alberta Poker research group, we are investigating opponent modeling improvements. Currently, our simple poker bot plays online against instantiations of PokiBots, the poker machine created by the University of Alberta research group. After some decision rule building, our poker bot is competitive. Our next step is to build upon this resea...
متن کاملAn Experimental Approach to Online Opponent Modeling in Texas Hold'em Poker
The game of Poker is an excellent test bed for studying opponent modeling methodologies applied to non-deterministic games with incomplete information. The most known Poker variant, Texas Hold'em Poker, combines simple rules with a huge amount of possible playing strategies. This paper is focused on developing algorithms for performing simple online opponent modeling in Texas Hold'em. The oppon...
متن کاملUniversity of Alberta expert poker agent: A survey
Games have always been a natural topic for Artificial Intelligence researchers to study and poker has proven to be a game that is both interesting and challenging. Part of the challenge of poker comes from the fact that it is a game of imperfect knowledge where multiple competing agents must deal with risk management, agent modeling, unreliable information and deception, much like decision-maki...
متن کاملActive Sensing for Opponent Modeling in Poker
One approach to designing an intelligent agent capable of winning competitive games such as Texas hold’em poker is to use opponent modeling to learn about an opponent’s behavior, then exploit that knowledge to maximize long term winnings. However, opponent modeling can suffer from several problems, including slow convergence due to a lack of a priori knowledge, noisy or dynamic opponent behavio...
متن کامل